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Description 

Field Of The Invention 

This invention relates to a computer system and, 
more particularly, to a lock out avoidance mechanism 
used in the computer system to prevent a situation 
wherein lock requests generated by the system devices 
are never serviced by the system. 

Background of The Invention 

In multiprocessor systems, any of a number of proc- 
essors or devices may desire exclusive access to a 
shared resource in the system. These shared resources 
can be, for example, a memory location such as a block 
of memory, longword, byte, etc. In order to obtain exclu- 
sive rights to the memory location, the processor gen- 
erates an interlock signal in the form of a lock request 
which will lock that particular location in memory to a 
device requesting access and thus deny any other proc- 
essor or device interlocked access to the particular 
memory location. Once the processor finishes with the 
particular memory location, an unlock request is gener- 
ated to unlock the location, thus again allowing general 
access. 

The use of lock requests occurs most often when 
processors share a resource such as a particular data 
structure or table stored in the memory. In order to gain 
access to such shared resource, the processors syn- 
chronize using interlocked operation in memory loca- 
tions sometimes referred to as semaphores. Because 
only one processor is granted exclusive access to the 
semaphore any operations on the shared resource is 
thus serialized. It is possible that multiple processors 
wishing to access the resource simultaneously may 
generate lock requests for the semaphore. For example, 
if a system includes four processors (CPUs) or nodes 
from which lock requests can originate, it is possible for 
two or more processors to desire interlocked access to 
the same location at the same time. In this instance, one 
of the requests is refused and the refused node receives 
a retry signal instructing it to retry the lock request. Typ- 
ically, each of the CPUs or the memory itself must keep 
track of the locked memory locations, status of any 
pending lock requests, etc. In other systems using a 
central arbiter to receive the lock requests, the tracking 
of the lock requests occurs at the central arbiter. In either 
system it is possible, when multiple nodes require 
locked access to the same memory location, for one or 
more nodes to be denied access forever. This condition 
is referred to as lockout. 

Further, many systems include several levels c? 
processing, with each level having multiple sources 
which can generate lock requests. Therefore, lock out 
may occur at any level in the system wherein multiple 
lock requests are generated. In previous system de- 
signs the lock out condition was resolved either by throt- 



tling all requestors except the node locked out when this 
condition was detected by the system or by forcing 
queuing of all locked requests which enforced sequen- 
tially. This resulted in either a complex lockout avoid- 
5 ance protocol or slowed the system performance with 
respect to lock requests. 

Summary of the Invention 

10 Prior art publication by Kelter in Information Sys- 
tems, vol. 14, no. 2, 1989, Dortmund, Germany, pages 
1 75 to 1 80, titled "Deadlock-Freedom of Large Transac- 
tions in Object Management Systems', teaches how to 
prevent deadlocks between large transactions in object 

'5 management systems. I n object management systems, 
deadlocks cause undesirable consequences and 
should be avoided. To this end, a technique called pseu- 
do preclaiming is used. A queue protocol taught in the 
prior art publication allows granting of locks without de- 

20 lay on unlocked objects. Pseudo preclaiming protocol 
taught by this prior art arrangement guarantees that 
transactions which do not claim further objects will not 
run into deadlocks. 

The invention, in its broad form, resides in a method 

2S for avoiding lockout of lock requests from a plurality of 
nodes to share a common resource, and a lockout 
avoidance circuit, as recited respectively in claims 1 and 
5. 

The present invention overcomes the prior art prob- 

30 lems by providing an efficient and simple hierarchical 
system of lock out avoidance mechanisms for use in 
systems having central locations for receiving the lock 
requests. To avoid lock out, each of the mechanisms us- 
es a centralized queuing structure called a lock queue. 

35 The centralized queuing mechanism is used because 
all interlock signals, e.g., lock requests and unlock re- 
quests, are received at this central location. The lock 
queue contains as many entries as there are possible 
nodes from which lock requests can originate, but no 

40 one entry is specifically tied to any node. Each entry in 
the lock queue contains a valid indication field and a 
node identification (I.D.) field. The valid indication field 
indicates whether the lock request is valid and the node 
I.D. field stores the identification of the node generating 

45 the lock request. The lock queue further has a head and 
a tail entry. The head points to the first entry, i.e., the 
highest priority entry, in the queue and the tail points to 
the first available entry in the lock queue. Each time the 
head of the queue is serviced, i.e., its lock request is 

50 satisfied, the head of the queue moves to the next entry 
in line. If one of the nodes already has an entry in the 
queue which has not yet been serviced, then subse- 
quent Seek requests from that node will be written into 
the same place in the lock queue. This is possible be- 

55 cause the entries only contain the node I.D. and not the 
request itself. In this manner, the lock queue need only 
contain a number of entries corresponding to the 
number of nodes from which lock requests can origi- 
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nate. 

The lock queue is usually empty and lock requests, 
from the various nodes passing through the central lo- 
cation, only enter the lock queue, it, after a predeter- 
mined number of tries, they are unable to gain access s 
to a particular resource. For example, assume that a 
lock request from node 0 is refused access because the 
particular memory location was already locked or a reg- 
ister for allowing the lock request was not available, then 
the central location increments a refusal counter for the k> 
particular node. When the node, in this case node 0, re- 
tries its lock request, It will then again be either refused 
or granted access. If the lock request is refused a pre- 
determined consecutive number of times while the lock 
queue is empty, then the node's I.D. will be stored at the 
head of the lock queue along with an indication of its 
validity. 

Because the lock queue is no longer empty, any 
subsequent lock requests from any other node in the 
system will be refused access to any location and will 20 
immediately enter the lock queue in the order in which 
they are serviced by the central location. When a lock 
request at the head of the queue is serviced, then the 
next waiting request in the queue becomes the head of 
the queue. 2$ 

In this manner, a lock out avoidance mechanism is 
operated such that if the lock queue is empty, it is difficult 
to enter the lock queue because a particular lock request 
must be refused the predetermined number of times be- 
fore the lock request may enter the queue. Once in the 30 
queue, the lock requests are serviced serially which 
slows down the system. Therefore, the lock queue is op- 
erated to try to keep the queue empty by using the re- 
fusal counter. This operation ensures that the queue is 
usually empty. However, once the lock queue is no long- 35 
er empty all future lock requests are serviced strictly by 
their queue position. This operation continues until the 
lock queue again becomes empty. Thus, the lock out 
avoidance mechanism at this level guarantees that each 
node will eventually have its lock request serviced. *o 

The present invention provides a similar lock out 
avoidance scheme at each level in the system wherein 
a lock out condition can occur. For example, a typical 
multiprocessor system has a number of hierarchical lev- 
els. A first level has each of the processors in the system 45 
vying for access to the system bus. The second level 
has devices within each processor, such as a processor 
chip and an interface chip, vying for access to the proc- 
essor's bus. Further levels can include devices coupling 
through the interface chip which try to access the inter- so 
face bus, etc. 

Assuming in our second level that for each proces- 
sor of a multiprocessor system, there are two sources 
of lock requests, I.e., the processor chip itself and other 
devices interfacing therewith, then the lock out avoid- 55 
ance mechanism at this level consists of a two entry 
queue. Each entry in the queue contains two fields: 1 ) 
an entry valid and 2) source I.D. As long as the lock re- 



quests are not refused, the queue will remain empty 
However, if a lock request from, for example, the proc- 
essor chip is refused, then that lock request immediately 
enters the head of the queue. From that point onward 
until the request is granted, only the processor chip's 
lock requests can be output onto a bus to the central 
location, if another device generates a lock request at 
the second level, the lock request enters the queue be- 
hind the processor chip's entry and is internally refused 
by the processor. When the head of the queue's lock 
request is eventually satisfied, i.e., the processor chip 
is finally granted access, the entry is popped from the 
queue and the next device becomes the head of the 
queue. Thus, a lock out avoidance mechanism is pro- 
vided at a second level in the system. 

As a result of providing a lock out avoidance mech- 
anism at each level wherein multiple sources can gen- 
erate lock requests and hence lock outs could occur, the 
present invention guarantees that every lock request 
generated in the system will eventually be serviced. 

Brief Description Of The Drawings 

Figure 1 is a block diagram of a system advanta- 
geously employing the present invention. 

Figure 2 is a block diagram of the central arbiter in- 
cluding the lock logic of the present invention. 

Figure 3 is a block diagram of one of the CPU mod- 
ules in Figure 1. 

Figure 4 is a detailed block diagram of the lock logic 
of the present invention. f 

Figure 4a is a block diagram of a lock register entry. 

Figure 4b is a diagram of an entry in the lock queue. 

Figure 5 is a diagram of the lock queue at the proc- 
essor level in the system of Figure 1. 

Detailed Description 

System Overview 

Fig. 1 is a block diagram of a system which advan- 
tageously uses the present invention. As illustrated, " 
there are four CPU's 0-3 indicated as blocks 11-14, re- 
spectively. These blocks 11 -14 are coupled to a central 
unit, indicated by dashed line 15, to be described in 
more detail below. Each of the CPUs 1 1 -1 4 is connected 
to the central unit 1 5 over a point to point bus, hereinafter 
referred to as an E-BUS TA, the E-BUS TA for CPU 0 
being designated as 17, the corresponding bus for CPU 
1 as 18, and so on accordingly. Each CPU 11-14 also 
receives output on an E-BUS FA from the central unit 
15, the four buses being designated respectively as 21 
through 24. Alec ohewn in the illustrated embodiment, 
each of the CPUs 11-14 communicates with a bus adap- 
tor XJA 25 over two 16-bit buses, i.e., an input and an 
output bus, with the bus adaptor 25 converting this in- 
formation to another bus 27. A console 26 is associated 
with at least one of the CPUs 11-14. 
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The system also includes a shared memory made 
up of a plurality of memory modules 31a to 31 n which 
are coupled to the central unit 1 5 over what is designat- 
ed A-BUS FA 33 and what is designated as A-BUS TA 
35. The A-BUS FA 33 carries outputs from the central 5 
unit 1 5 to the memory modules and the bus 35 provides 
memory information to the central unit 15. In the illus- 
trated embodiment, buses 17-24 and 33 are 32-bit par- 
allel buses and bus 35 is a 64-bit parallel bus. The E- 
BUSES operate at 8ns timing and the A-BUSES at 1 6ns 
in this embodiment. 

Fig. 1 further shows a configuration for the central 
unit 1 5. A multiplexer, designated generally by 37, is pro- 
vided in the central unit 15. As will be shown below, the 
multiplexer 37 is made up of several multiplexers ad- 
vantageously coupled together. At the inputs to the mul- 
tiplexer 37 is a port logic block 49 composed of port logic 
units 49a. Each port logic unit 49a includes a buffer 53 
for each input port, i.e., each E-BUS TA 17-20. Each of 
the buffers 53 in the port logic units 49a can hold three 
words for each of buses 17-20 from CPUs 11-14. Out- 
puts from the buffers 53 are coupled into scheduler ar- 
bitrator logic 50 which arbitration logic 50 provides out- 
puts to control multiplexer 37. One of the general out- 
puts of MUX 37 is fed to a write buffer 10 which is cou- 
pled to memory modules 31a-n via the bus 33. 

Fig. 2 is a more detailed block diagram of the central 
unit 15 of Fig. 1 showing a port select logic 65 and re- 
source check 67 which together compose the schedul- 
er/arbitrator 50 of Fig. 1 and its relationship to other el- 
ements of the system. Port select logic 65 is combined 
with multiplexer 37a to form scheduling logic 66. Re- 
source check logic 67 combines with MUX 37b and state 
device 42 to form arbitrator 51 . As illustrated, the buses 
17-20 are inputs to the port logic 49. Each CPU is con- 
sidered a system port. Individual port logic units, desig- 
nated 49a-d, are provided for each of the buses 17-20. 
The bus information enters a state device 53a, forming 
part of the buffer 53 of Fig. 1, from which it is directed 
to buffer 53b, also forming part of buffer 53 in Fig. 1 . The 
buffer 53b has storage space for three words. The out- 
put from the state device 53a is also provided into va- 
lidity logic 57. The validity logic 57 controls a port mul- 
tiplexer 59. The validity logic 57 also receives a port 
grant signal on line 61 from the arbitrator 51 . Validity log- 
ic 57 determines whether or not a command or data are 
valid and which of the data, either in the buffers 53b or 
on the input line from the state device 53a, is to be 
switched out onto an output line 63 which provides one 
of the inputs to a multiplexer 37a (part of MUX 37 in Fig. 
1 ). The outputs on lines 63 from the port multiplexers 59 
are the inputs to the multiplexer 37a. Associated with 
the multiplexer 37a is port selection or scheduling logic 
65. In response to outputs from the arbitrator 51 , and its 
own logic, the port select logic 65 selects one of the four 
input lines 63 to be coupled to the output of multiplexer 
37a. This, of course, must be coordinated with the op- 
eration of the logic 57 which is switching outputs onto 



the lines 63. The port select logic 65 basically operates 
so as to provide the four ports providing their inputs on 
line 63 a round robin access to bus 36. 

Bus 36 is an input to a resource check block 67 
which is part of the arbitrator 51 . Bus 36 is also an input 
to the multiplexer 37b (also part of MUX 37 in Fig. 1). 
Bus 36 is also coupled to a memory map unit CMMAP") 
69, lock logic unit ("LOCK') 71, input/output unit 
("CPIO") 73, interrupt request unit ("IREQ/SNIT") 75, 
memory controller ( "MEMC/DBEC ") 77 and memory 
write data path unit ("MWDP") 79. Each of the blocks 
69, 71, 73, 75 and 77 also provide inputs to the multi- 
plexer 37b. In addition, the resource check 67 can pro- 
vide an ARB command to the multiplexer 37b. 

The previously described A-BUS TA is provided as 
an input to a memory read data path 81 which provides 
its input into the memory controller, i.e., the MEMC/DE- 
BC 77, the output of which is the memory controller refill 
data which is one of the inputs to multiplexer 37b. An 
output of MEMC/DBEC 77 is also provided onto the line 
33, i.e., the A-BUS FA line. The output from the multi- 
plexer 37b is provided through a state device 42. The 
output of state device 42 forms the E-BUS FA buses that 
couple to all the CPUs. 

Each of the blocks 69, 71 , 73, 75, 77 and 79 provide 
an input to the resource check 67 which utilizes this in- 
formation and the presence of a command on the bus 
36 to arbitrate between the different inputs which want 
access to the multiplexer 37b. It grants access via its 
output lines coupled through state devices 67a and 67b. 
One set of output lines is the output lines 83 leading from 
the resource check 67 to each of the blocks 69, 71 , 73, 
75, 77 and 79. The other are the lines 61 and 85 leading, 
respectively, to the port logic 49 and the port select logic 
65. 

Fig. 3 is a more detailed block diagram of one of the 
CPU modules 11-14 (in this case CPU 0) shown in Fig. 
1 . The CPU module 1 1 has three major component chips 
including an interface (X) chip 1 02, a processor (P) chip 
104 and cache interface (CF) chip 100. The processing 
chip or P chip 104 is coupled with a cache memory 106. 
The processing chip 104 further couples with a cache 
tag store 110 by which it requests an address over line 
1 1 2 and receives a tag entry via line 1 1 4. The P chip 1 04 
makes use of lines 116 to enable data to be written to 
the cache memory 106. Further, lines 118 provide the 
data and error correction codes (ECC) from the cache 
memory 106 to the processing chip 104. 

The cache memory 106 is shown in this example 
composed of random access memories (RAMs). The 
cache 106 further receives data and ECC information 
from the CF chip 100 over lines 1 20. The operation of a 
cache memory, 1-06 along with its associated cache tag 
store 1 10 is well known to those skilled in the art and will 
not therefore be discussed. 

The X chip 102 provides an interface totheXJAbus 
adaptor 25 (Fig. 1). The X chip 102 provides outputs to 
the CF chip 100 and receives inputs therefrom. Further, 



15 



20 



25 



30 



35 



40 



45 



50 



4 



7 



EP 0 464 715 B1 



8 



the X chip 102 interfaces with a console support block 
108 for interfacing with a console terminal 26 (Fig. 1). 

The CF chip 100 provides outputs to the cache tag 
store 110 including new tag entry and write enable in- 
formation. Further, the CF chip 100 receives address 
and data operands, along with parity information, from 
the processing chip 104. The CF chip 100 couples the 
CPU with the E BUS TA and E BUS FA as indicated by 
bus lines 17 and 21, respectively. 

Interlock Queueing 

Referring back to Fig. 1, it is often desirable for 
some device such as one of the CPU modules 0-3 or an 
I/O unit or device through the XJA adaptor to gain ex- 
clusive access to a particular unit or location of the mem- 
ories 31a-31n. For example, one of the CPU modules 
11-14 may desire to lock a block of data, a longword, a 
byte, etc., in one of the memory modules 31a-31n. To 
do so, the device generates a lock request in the form 
of a READ LOCK command. This command will lock the 
particular memory location allowing the resource exclu- 
sive access thereto. Once the location is locked no other 
CPU's lock request to that location will be allowed. Once 
the resource has completed its operations on the loca- 
tion, a WRITE UNLOCK command is generated to free 
the memory location. The precise operation of these 
commands is described below with respect to Figure 4. 

In the example of Fig. 1, there are four E BUS 
nodes, corresponding to CPU modules 0-3, from which 
lock requests can originate. Still further, as seen from 
Fig. 3, each node on the E BUS, in this case the CPUs, 
also includes more than one resource which may gen- 
erate lock requests, for example, the P chip 104 or the 
X chip 102. In this instance, the CF chip 100 functions 
to insure that neither the processing chip's 104 or X 
chip's 102 lock requests are locked out from being serv- 
iced. Similarly, the central unit 15 must insure that no 
lock out occurs for any of the nodes on the E BUS. 

Referring to Fig. 2, the central unit 15 makes use of 
lock block 71 which includes lock logic to be described 
below in Fig. 4, to insure that no node is ever locked out 
from having its lock request satisfied. Further, the CF 
chip 100 in the CPU shown in Fig. 3 includes lock logic 
1 25 for insuring that neither the CPU nor the X chip are 
ever locked out from having their lock requests satisfied. 
In this manner as will be fully described below, a hierar- 
chy of lock out avoidance mechanisms, i.e., lock logic 
71 and lock logic 125, are utilized to insure that every 
lock request is eventually serviced. 

Referring to Fig. 2, lockout avoidance is performed 
at the highest level by the lock logic 71 in the central unit 
. l5-,The use of the central unit 15 to keep track of lock 

locations and to avoid lockouts provides an advantage 
over conventional multi-drop buses wherein each CPU 
or memory coupled to the bus must keep track of the 
locked data. Because the central unit 1 5 receives all lock 
requests and maintains lock registers, it provides the op- 



portunity to implement centralized queueing mecha- 
nisms to avoid the lockouts. 

Fig. 4 describes in greater detail the lock logic 71. 
The lock logic 71 includes a predetermined number of 

5 lock registers 80a-80n, in the example shown V equals 
eight, but it is understood to depend upon the require- 
ments of the system. Each of the lock registers 80a-80n 
stores the address of a particular memory location to be 
locked. For this example having eight lock registers, up 

10 to eight memory locations can be locked at any given 
time. The outputs from each of the register blocks 80a- 
80n are the result of a compare performed between 
each of the lock registers and the address of an incom- 
ing lock request on bus 36. The output of OR gate 82 

15 provides either a LOCK HIT or LOCK MISS signal. The 
LOCK HIT signal is provided to further logic 84 which 
outputs a LOCK REFUSED signal to the resource check 
67 in the arbiter 51 (Fig. 2). The LOCK MISS signal is 
provided as an input to a write control 86. 

20 Each lock register 80a-80n includes a register 88 
and a comparator 90. The register 88 stores an address 
of the memory location desired to be locked along with 
an indication of its validity, i.e., locked or unlocked, as 
shown in Fig. 4a. The register 88 is composed of several 

25 fields including a lock register valid bit field, node source 
ID, and byte addresses. The register 88 is enabled via 
commands from the write control block 86. 

The command and address received from the 
schedule logic 66 (Fig. 2) over bus 36 is provided in par- 

30 allel to the comparators 90 in each of the lock registers 
80a-80n. The command and address are further provid- 
ed to delay logic 92 which has an output coupled in par- 
allel to the registers 88 in each of the lock registers 80a- 
80n. The output from the registers 88 are provided as 

35 another input to the comparators 90 in each of the lock 
registers. The output from the comparators 90 in each 
of the lock registers is then provided to the OR gate 82 
mentioned above. 

A lock queue, shown generally by dotted line 130, 

40 is composed of several state devices 94a-94d chained 
together. The number of entries in the lock queue (in this 
example four) correspond to the number of nodes. An 
example of one of the state devices 94a-94d is shown 
in greater detail in Fig. 4b functioning as a lock queue 

45 register entry including a lock queue register valid bit 
and node source ID bits. Coupled with each state device 
94a-94d is an associated multiplexer 96a-96d. The reg- 
isters 94a-94d and multiplexers 96a-96d are coupled to- 
gether to form the lock queue 130 which functions as 

50 will be described below. A comparator 98a-98d is asso- 
ciated with each individual state device and multiplexer 
94, 96 and receives an input therefrom. Further, the 
comparator 98 receivcsvsr. input from the command ad- 
dress bus 36. Each of the comparators 98a-98d pro- 

55 vides an output to OR gate 99. The OR gate 99 provides 
inputs to OR gate 84 and to write control logic 86. The 
write control logic 86 also receives inputs from each 
comparator 90 in the lock register blocks 80a-80n and 
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each comparator 98a-98d associated with the lock 
queue 130. 

The write control logic 86 provides a LOCK REGIS- 
TER WRITE CONTROL signal to each of the registers 
88 in the lock registers 80a-80n. Further, the write con- s 
trol block 86 provides a LOCK QUEUE REGISTER 
WRITE CONTROL signal to enable the multiplexers 
96a -96d associated with state devices 94a-94d to oper- 
ate in accordance with the lock queue 1 30 design. Also, 
a REFUSAL COUNTER INCREMENT CONTROL sig- to 
nal is provided from write control 86 to a plurality of re- 
fusal counters 131-136. Each refusal counter is associ- 
ated with a node, such as CPU modules 0-3 (Fig. 1 ) in 
the system. The refusal counters 131-136 are incre- 
mented by signals from the write control 86. Once a par- 15 
ticular refusal counter reaches a predetermined limit, an 
END OF COUNT signal is provided to the write control 
86. The predetermined limit in the refusal counter is op- 
timized for the best performance for lock requests in the 
system. The write control 86 further receives from the 20 
arbiter 51 (Fig. 2) a LOCK CLEAR and LOCK SET sig- 
nal. 

In operation, assuming all of the lock registers 80a- 
80n are available for use, a READ LOCK command and 
an associated memory address to be locked are provid- 
ed in parallel to the comparators 90 in each of the lock 
registers 80a-80n. Each of the respective comparators 
90 compares the address with the address previously 
stored in its associated register 88. In this example, be- 
cause each of the lock registers is initially empty, the 
comparators 90 do not generate any matches as an out- 
put to the OR gate 82. Therefore, the output from the 
OR gate 82 provides a LOCK MISS signal to the write 
control 86. The write control 86 then provides a LOCK 
REGISTER WRITE CONTROL signal to registers 88 to 
enable a particular one of the registers 88 in the lock 
registers 80a-B0n and to set the valid bit. The particular 
block which is enabled by the LOCK REGISTER WRITE 
CONTROL signal is determined by a predefined proto- 
col in the write control 86. By enabling the register 88 
with the signal, the READ LOCK command stores its 
associated address in the register 88 from line 89 after 
having been provided as an input thereto from bus 36 
through the delay logic 92. Further the write control 86 
sets the valid bit in register 88 to indicate the memory 
location is locked. The delay logic 92 functions to suffi- 
ciently delay the command and address so as to arrive 
at the register 88 once the write control 86 generates its 
LOCK REGISTER WRITE CONTROL signal, enabling 
storage at a predetermined location. In this manner, up 
to eight lock addresses can be stored in the lock regis- 
ters 80a-80n. 

: . v ..^Associated with each READ LOCK command is a 
WRITE UNLOCK command and associated address. 
The WRITE UNLOCK command is necessary to unlock 
the particular memory location once the resource has 
finished its use. Referring back to Fig. 4, WRITEUN- 
LOCK commands are never refused by the lock logic 



71 . A WRITE UNLOCK command and associated ad- 
dress on bus 36 provides a LOCK MISS output to the 
write control 86 which provides a LOCK REGISTER 
WRITE CONTROL signal to clear the valid bit in the par- 
ticular register 88 in the lock register block 80a-80n cor- 
responding to the WRITE UNLOCK command. 

Once all of the lock registers are filled with valid ad- 
dresses of locked locations, as indicated by the lock reg- 
ister valid bit in register 88 (Fig. 4a), then any subse- 
quent lock requests will be refused. Similarly, if a lock 
request is generated for a particular memory location 
which is already locked, then that lock request will also 
be refused. For example, assuming a first READ LOCK 
command was allowed for address 00 in the memory, 
then one of the registers 88 will contain address 00 and 
its lock register valid bit will be set. If a subsequent 
READ LOCK command also desires to access address 
00, then the one comparator 90 associated with the reg- 
ister 88 storing that particular address will generate a 
match signal to OR gate 82. The OR gate 82 thus pro- 
vides a LOCK HIT signal to OR gate 84 which in turn 
outputs a LOCK REFUSED signal to the resource check 
67 in the arbiter. 

Referring back to Fig. 2, the LOCK REFUSED sig- 
nal is provided as an input to the resource check 67 
which enables multiplexer 37b to provide a retry signal 
on the particular E BUS 21-24 from which the READ 
LOCK command was generated. 

Referring back to Fig. 4, when a match is generated 
from one of the comparators 90 in one of the lock reg- 
isters 80a-80n, a signal is sent over line 200 to the write 
control 86. The match indicates that the memory loca- 
tion is currently locked. The write control 86 then pro- 
vides a REFUSAL COUNTER INCREMENT CONTROL 
signal. The REFUSAL COUNTER INCREMENT CON- 
TROL signal enables the particular refusal counter 
1 30-1 36 associated with the node generating the READ 
LOCK command which was refused. This signal incre- 
ments the countei. 

Similarly, when all of the lock registers 80a-80n are 
filled with a valid address and not the address for which 
the lock is requested, then the LOCK MISS signal pro- 
vided from OR gate 82 to the write control 86 will enable 
the REFUSAL COUNTER INCREMENT CONTROL 
signal. This is possible because the write control 86 in- 
ternally tracks the number of valid lock registers and 
therefore knows when the lock registers 80a-80n are 
filled. 

Once a refusal counter 131-136 has been incre- 
mented a predetermined number of times, the END OF 
COUNT signal is provided to the write control 86. This 
generates a LOCK QUEUE REGISTER WRITE CON- 
TROL signal from the write control 85 to the lock queue- 
130. The node source ID and the lock queue register 
valid bit (Fig. 4b) are then loaded and set, respectively, 
into the top of the queue 94d by enabling the multiplexer 
96d for the particular READ LOCK command and asso- 
ciated address from bus 36. This lock request then be- 
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comes the head of the lock queue 1 30. Once the lock 
queue 130 contains a valid entry, any subsequent lock 
requests from other nodes will be automatically refused 
(regardless of whether the other conditions for refusing 
locks are satisfied) and will be stored in the queue 1 30. * 

The LOCK QUEUE REGISTER WRITE CONTROL 
signal can implement several functions. These functions 
include a Hold signal, Update signal and Push To Top 
of Queue signal. These signals are described below with 
respect to the queue 1 30 operation. io 

The LOCK QUEUE REGISTER WRITE CONTROL 
signal is next input to multiplexer 96c which enables the 
second lock request to be stored in location 96c in the 
lock queue 130. If another lock request is generated 
from a node already stored in the lock queue 130, that is 
request will then generate the LOCK QUEUE REGIS- 
TER WRITE CONTROL hold signal that enables the 
middle line of the multiplexers currently storing the same 
entry 94. This new request then is stored in the same 
queue position. 20 

Each entry in the lock queue 130 is provided as an 
input to its associated comparator 98a-98d. Further, the 
information on bus 36 is also provided to each of the 
comparators 98a-98d. The output from the comparators 
98a-98d are provided as parallel inputs to OR gate 99 25 
which provides an output both to OR gate 84 (QUEUE 
HIT) and to write control 86. 

The lock queue 130, as shown in Fig. 4, has as 
many entries as there are nodes coupled to the central 
unit 15. As used in the present example, the four entry 30 
lock queue, i.e., entries 94a-94d, is required because of 
the four possible E BUS nodes from which lock requests 
may originate. Again, as shown in Fig. 4b, each entry in 
the queue 1 30 is composed of two parts: a valid bit, in- 
dicating whether the entry is valid, and a slot ID which 35 
points to one of the E BUS CPU nodes. 

Every time the head entry 94d of the lock queue 1 30 
is serviced, i.e., its lock request is satisfied, the lock 
queue is pushed by the LOCK QUEUE REGISTER 
WRITE CONTROL push to top of queue signal enabling 40 
the lower input to the multiplexers 96a-96d. This has the 
effect of pushing the entries upward in the queue to cre- 
ate a new head of queue and making available the bot- 
tom entry 94a. For this reason, the lock queue 1 30 need 
only be of a depth equal to the number of nodes on the 
E BUS which can generate lock requests. 

An example of the lockout avoidance mechanism 
operation will now be given. Lock requests are generat- 
ed from the various nodes (Fig. 1 ) in the form of READ 
LOCK commands and an associated address location so 
and are received by the central unit 1 5 through their re- 
spective port logics 49a. The request passes through 
. the,schedjj|ing^!ogic 66 and into the lock logic 71 (Fig. 
2) on bus 36. As long as the lock request is not refused 
by the lock logic 71 , the request does not enter the lock ss 
queue 130 (Fig. 4). However, assuming the lock request 
from node 0, i.e., CPU 0, is refused because the partic- 
ular location in memory has already been locked or be- 



cause no free lock registers 80a-80n are available for 
allocation to the lock request, then the write control 86 
increments the refusal counter 1 31 -1 36 for the particular 
node, in this case CPU 0. After a predetermined period 
of time, CPU 0 again retries its lock request. If the lock 
request from CPU 0 is again refused, its respective re- 
fusal counter is incremented once more. Once a lock 
request has been refused a predetermined consecutive 
number of times while the lock queue 1 30 remains emp- 
ty, the write control 86 then places the identification for 
the particular node at the head of the lock queue 130. 
Only the node ID (Fig. 4b) is stored in the lock queue 
and not the address of the lock request that was refused. 

Because the lock queue 130 is no longer empty, a 
subsequently arbitrated lock request from any other 
node will be refused and will also enter the lock queue 
130 in the order in which it is serviced by the arbiter 51 . 
Once a lock request from the head of the queue is serv- 
iced, the next waiting lock request in the lock queue 1 30 
is pushed to the head of the queue via the LOCK 
QUEUE REGISTER WRITE CONTROL push to top of 
queue signal and the operation of the multiplexers 96a- 
96d. 

This operation assures that whenever the lock 
queue 1 30 is empty, it is difficult to enter the lock queue 
130 because the lock requests from a particular node 
must be refused a predetermined consecutive number 
of times. Therefore, the lock queue 1 30 is predominantly 
kept empty, assuming the refusal counter is set at a high 
enough value. However, once the lock queue 130 has 
an entry, all future lock requests are serviced strictly by 
their lock queue position, i.e. , the head of the queue gets 
satisfied first, the second entry is satisfied next, etc. This 
operation continues until the lock queue 1 30 is again 
empty. 

In summary, the lock logic generates a LOCK RE- 
FUSED signaling response to a READ LOCK command 
from a node in three instances: 1 ) the lock queue is not 
empty and the requesting node is not the head of the 
queue; 2) no free lock registers are available; or 3) the 
particular memory block desired is already locked. 

Because the lock requests are unconditionally 
queued in the lock queue 1 30 once the lock queue 1 30 
is no longer empty, the address of the refused lock re- 
quest is not important. So long as each node guarantees 
that it will never lockout any of the multiple sources of 
lock requests it receives, the central unit 15 guarantees 
that every lock request, regardless of its address, has a 
fair and equal chance of entering the lock queue 1 30 
and hence, eventually reaching the head of the lock 
queue 130 for servicing. 

The above description guarantees that no lockout 

will occur at the highest level in the systorr.. However, 

to guarantee that lockouts do not occur anywhere in the 
system, lockout avoidance mechanisms must be in 
place wherever multiple sources of lock requests are 
generated. Thus, while the central unit 15 avoids lock- 
outs for each of the nodes, i.e. , the CPUs coupled there- 
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to, via lock logic 71 , a lockout avoidance mechanism is 
necessary in each node to avoid lockouts of other sourc- 
es of lock requests. 

Referring again to Fig. 3, the CPU block diagram 
includes the CF chip 100 which has a lock logic 125. 
This lock logic 125 prevents lockouts of either the proc- 
essor chip's 104 or X chip's 102 lock requests. The lock 
logic 125 operates similarly to the lock logic 71 shown 
in Fig. 2. Because the lock queue 1 30 in the central unit 
15 does not store addresses nor whether the lock re- 
quest was from either the X chip or the processor chip 
104, it is possible that either the processor chip or the 
X chip can lock the other out from ever having their lock 
request satisfied. 

Fig. 5 illustrates the two entry queue used in the lock 
logic 125 oftheCF chip 100. In this example, the queue 
134 includes two entries, each of which includes two 
bits: 1) an entry valid bit; and 2) a source ID bit, e.g., X 
chip or processor chip. 

In operation, as long as a lock request from the 
processor chip or X chip is not refused by the central 
unit 15, the queue 134 remains empty. However, once 
a lock request from, for example, the processor chip, is 
refused by the central unit 15, the lock request immedi- 
ately enters the head of the queue 134. From this point 
onward, only the processor chip can have its lock re- 
quests forwarded onto the E BUS (and hence to the cen- 
tral unit 1 5) from the CF chip 1 00. If, for example, the X 
chip requests a lock, this request will enter the queue 
134 behind the processor chip's entry. Further, the X 
chip's lock requests will internally be refused by the CF 
chip 100 and thus prevented from going onto the E BUS. 

Once the head of the queue, in this example the 
processor chip entry, is eventually satisfied by the cen- 
tral unit 1 5, it is popped out of the queue 1 34 and the X 
chip's lock request becomes the new head of the queue 
134. 

The method used in the CF chip 100 for avoiding 
lockouts is as follows. If the queue 134 is empty, both 
the processor and X chip can send their respective lock 
requests to the central unit 1 5 via the E BUS 1 7-20. If a 
lock request is refused by the central unit 15, then the 
source of the lock request, i.e., processor or X chip, 
along with whether it is valid or invalid, is entered into 
the queue 1 34. It is important to note that if the source 
is already stored in the queue, it will maintain its queue 
position. 

The protocol used in the CF chip to avoid lockouts 
is essentially similar to the lock queue 1 30 used in the 
central unit. However, in this instance there is no need 
to implement a refusal counter in the CF chip 100, be- 
cause the frequency at which lock requests are gener- 
ated f romth*Xchip3t the CPU !9vel is not great enough 
to require the use of a refusal counter. 



Claims 

1. A method for avoiding lockout of lock requests for 
a shared resource, generated from a plurality of 
5 nodes coupled to a central location, the method 
comprising the steps of: 

incrementing a counter associated with a par- 
ticular one of the nodes when a lock request 
10 from said particular node is refused in the cen- 

tral location; 

generating an end of count signal from said 
counter when the lock request is refused a pre- 
determined number of times; 
is storing the lock request as a head entry in a 

queue once the end of count signal in generat- 
ed; 

subsequently storing any further lock requests 
from any other of the nodes at the tail of the 
20 queue as further entries in said queue once the 

queue contains a head entry; and 
operating said queue to the entries in the order 
in which they are placed in the queue. 

25 2. A method according to claim 1 , wherein the step of 
storing the lock request comprises generating a first: 
signal to enable a first register in said queue to store 
the lock request. 

30 3. A method according to claim 2, wherein the step of 
subsequently storing comprises generating a sec- 
ond signal to enable a next register in said queue 
to store the next lock request from a different node. 

35 4. A method according to claim 3, wherein the step of 
operating the queue comprises: 

generating a third signal to push said queue 
once the head entry is serviced such that the 
40 next entry in the queue becomes the head en- 

try; and 

continuing to generate the third signal each 
time the head entry is serviced until the queue 
is empty. 

45 

5. A lockout avoidance circuit for a plurality of nodes 
coupled to a central location and generating lock re- 
quests for a shared resource, comprising: 

so a lock queue having a head and tail; 

means for counting lock requests that have 
been refused from at least one of those nodes; 
means for enabling the queue to store a J ,cc!; 
request from the node at the head of the queue 

55 after a predetermined number of lock requests 

from the node have been refused, and storing 
all subsequent lock requests from any other of 
the nodes at the tail of the queue in the order 
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in the order in which they are requested; and 
means for enabling operating the queue to ad- 
vance the stored lock requests from the tail end 
of the queue toward the head of the queue each 
time the lock request at the head of the queue 
is serviced. 

6. A circuit according to claim 5, including a control cir- 
cuit coupled to the lock queue, wherein the lock 
queue includes a plurality of queue registers each 
having a storage device and wherein the plurality of 
queue registers provide either a lock refused or lock 
miss signal in response to a lock request; and 

the lock miss signal being forwarded to the 
control circuit to activate the first signal for storing 
the lock request. 

7. A circuit according to claim 5 wherein said lock 
queue includes a plurality of queue registers and 
further comprises; 

a plurality of multiplexers, one of the multiplex- 
ers being associated with each one of the 
queue registers, said multiplexers receiving a 
second signal for operating the lock queue. 

8. A circuit according to claim 6 wherein the lock re- 
fused signal enables the control circuit to generate 
a third signal to the respective counter associated 
with the node generating the lock request. 

9. A circuit according to claim 6, wherein each queue 
register comprises: 

a valid indication field; and 
a node source ID field. 

10. A circuit according to claim 9 wherein each storage 
device includes: 

an address field; 

a node source ID field; and 

a valid indicator. 



Patentanspruche 

1. Verfahren zum Vermeiden der Aussperrung von 
Verriegelungsanforderungen fur ein gemeinsam 
genutztes Betriebsmittel, die von mehreren Knoten 
erzeugt werden, die an eine zentrale Einrichtung 
gekoppelt sind, wobei das Verfahren die folgenden 

.. . .Schrfce rf epth?.!t: ■ - .. 

Inkrementieren eines einem besonderen der 
Knoten zugeordneten Zahlers, wenn eine Ver- 
riegelungsanforderung von diesem besonde- 
ren Knoten in der zentralen Einrichtung abge- 



wiesen wird; 

Erzeugen eines Zahlendesignals vom Zahler, 
wenn die Verriegelungsanforderung in einer 
vorgegebenen Anzahl abgewiesen worden ist; 

5 Speichern der Verriegelungsanforderung als 

einen Kopfeintrag in einer Warteschlange, so- 
bald das Zahlendesignal erzeugt worden ist; 
anschlieGend Speichern irgendwelcher weite- 
rer Verriegelungsanforderungen von irgend- 

10 welchen anderen der Knoten am hinteren Ende 

der Warteschlange als weitere Eintrage in der 
Warteschlange, sobatd die Warteschlange ei- 
nen Kopfeintrag enthalt; und 
Bearbeiten der Eintrage der Warteschlange in 

is der Reihenfolge, in der sie in der Warteschlan- 

ge gesetzt werden. 

2. Verfahren nach Anspruch 1 , bei dem der Schritt des 
Speicherns der Verriegelungsanforderung das Er- 
20 zeugen eines ersten Signals enthalt, mit dem ein 
erstes Register in der Warteschlange freigegeben 
wird, urn die Verriegelungsanforderung zu spei- 
chern. 

25 3. Verfahren nach Anspruch 2, bei dem der Schritt des 
nachfolgenden Speicherns das Erzeugen eines 
zweiten Signals enthalt, mit dem ein nachstes Re- 
gister in der Warteschlange freigegeben wird, urn 
die nachste Verriegelungsanforderung von einem 

30 anderen Knoten zu speichern. 

4. Verfahren nach Anspruch 3, bei dem der Schritt des 
Bearbeitens der Warteschlange enthalt: 

35 Erzeugen eines dritten Signals, urn die Warte- 

schlange zu verschieben, sobald der Kopfein- 
trag bedient worden ist, so daG der nachste Ein- 
trag in der Warteschlange zum Kopfeintrag 
wird; und 

40 fortgesetztes Erzeugen des dritten Signals je- 

desmal, wenn der Kopfeintrag bedient wird, bis 
die Warteschlange leer ist. 

5. Aussperrungsvermeidungsschaltung fur mehrere 
45 Knoten, die an eine zentrale Einrichtung gekoppelt 

sind und Verriegelungsanforderungen fur ein ge- 
meinsam genutztes Betriebsmittel erzeugen, mit: 

einer Verriegelungswarteschlange mit einem 
50 vorderen Ende und einem hinteren Ende; 

einer Einrichtung zum Zahlen von abgewiese- 
nen Verriegelungsanforderungen von wenig- 
stens einem dieser Knoten; 
einer Einrichtung zum Freigeben der Warte- 
55 schlange, urn eine Verriegelungsanforderung 

von dem Knoten am vorderen Ende der Warte- 
schlange zu speichern, nachdem Verriege- 
lungsanforderungen in einer vorgegebenen 
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Anzahl von dem Knoten abgewiesen worden 
ist, und zum Speichern aller nachfolgenden 
Verriegelungsanforderungen von irgendwel- 
chen anderen der Knoten am hinteren Ende der 
Warteschlange in der Reihenfolge, in der sie 5 
angefordert werden; und 
einer Einrichtung zum Freigeben der Bearbei- 
tung der Warteschlange, urn jedesmal, wenn 
dieVerriegelungsanforderungam vorderen En- 
de der Warteschlange bedient worden ist, die 10 
gespeicherten Verriegelungsanforderungen 
vom hinteren Ende der Warteschlange zum 
vorderen Ende der Warteschlange vorzuschie- 
ben. 

75 

6. Schaltung nach Anspruch 5, die eine mit der Ver- 
riegelungswarteschlange gekoppelte Steuerschal- 
tung enthalt, wobei die Verriegelungswarteschlan- 
ge mehrere Verriegelungsregister enthalt, wovon 
jedes eine Speichervorrichtung besitzt, und wobei 20 
die mehreren Warteschlangenregister als Antwort 

auf eine Verriegelungsanforderung jeweils entwe- 
der ein Signal fur abgewiesene Verriegelung oder 
ein Signal fur fehlende Verriegelung erzeugen; und 

das Signal fur fehlende Verriegelung an die 2s 
Steuerschaltung geschickt wird, um das erste Si- 
gnal zum Speichern der Verriegelungsanforderung 
zu aktivieren. 

7. Schaltung nach Anspruch 5, bei der die Warte- 30 
schlange mehrere Warteschlangenregister enthalt 
und die ferner enthalt: 

mehrere Multiplexer, wobei jedem der Warte- 
schlangenregister einer der Multiplexer zugeordnet 
ist, wobei die Multiplexer ein zweites Signal zum 35 
Bearbeiten der Verriegelungswarteschlange emp- 
fangen. 

8. Schaltung nach Anspruch 6, bei der das Signal fur 
abgewiesene Verriegelung die Steuerschaltung *o 
freigibt, damit sie ein drittes Signal fur den jeweili- 
gen Zahler erzeugt, der dem die Verriegelungsan- 
forderung erzeugenden Knoten zugeordnet ist. 



Revendications 

1. Precede pour eviter I'interdiction d'acces pour des 
demandes de verrouillage d'une ressource parta- 
gee, generes a partir d'une multiplicite de noeuds 
couples a un emplacement central, le proced§ com- 
portant les etapes consistant: 

a incrementer un compteur associe a un noeud 
particulier parmi les noeuds lorsqu'une deman- 
de de verrouillage en provenance dudit noeud 
particulier est rejetee dans I'emplacement cen- 
tral; 

a generer un signal de fin de comptage a partir 
dudit compteur lorsque ladite demande de ver- 
rouillage a ete rejetee un nombre predetermine 
de fois; 

a emmagasiner la demande de verrouillage en 
tant qu'entree de tete dans une file d'attente 
une fois que le signal de fin de comptage a ete 
genere; 

a emmagasiner subsequemment toutes autres 
demandes de verrouillage emanant de n'impor- 
te lesquels des autres noeuds en queue de la 
file d'attente en tant que d'autres entrees de la- 
dite file d'attente une fois que la file d'attente 
contient une entr6e de t6te; et 
a commander ladite file d'attente par rapport 
aux entrees suivant I'ordre de leur placement 
dans la file d'attente. 

2. Procede selon la revendication 1 , dans lequel I'eta- 
pe de stockage de la demande de verrouillage con- 
sists a generer un premier signal pour autoriser un 
premier registre de ladite file d'attente a emmaga- 
siner la demande de verrouillage. 

3. Procede selon la revendication 2, dans lequel I'Sta- 
pe de stockage subsequent consiste a generer un 
second signal pour autoriser un registre suivant de 
ladite file d'attente a emmagasiner la demande de 
verrouillage suivante en provenance d'un autre 
noeud. 



9. Schaltung nach Anspruch 6, bei der jedes Warte- 
schlangenregister enthalt: 

ein Gultigkeitsanzeigerfeld; und 
ein Quellknoten-ID-Feld. 

10. Schaltung nach Anspruch 9, bei der jede Speicher- 
vorrichtung enthalt: 

ein Adressenf eld; 

ein Quellknoten-ID-Feld; und 

einen Gultigkeitsanzeiger. 



45 4. Proc6de selon la revendication 3, dans lequel l'6ta- 
pe de commande de la file d'attente consiste: 

a generer un troisieme signal pour pousser la- 
dite file d'attente une fois que I'entree de tete a 
so 6te prise en charge de sorte que I'entree sui- 

vante de la file d'attente devienne I'entree de 
tete; et 

a continuer a generer le troisieme signal cha- 
que fois que I'entree de tete est prise en charge, 
55 jusqu'a ce que la file d'attente soit vide. 

5. Circuit pour eviter les interdictions d'acces prevu 
pour une multiplicite de noeuds couples a un em- 
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7. 



placement central et generant des demandes de 
verrouillaged'une ressource partagee, comportant: 

une file d'attente de verrouillage ayant une tete 
et une queue; 5 
des moyens pour compter les demandes de 
verrouillage qui ont ete rejetees emanant d'au 
moins un desdits noeuds; 
des moyens pour autoriser ia file d'attente a 
emmagasiner une demande de verrouillage en 10 
provenance du noeud a la tete de la file d'at- 
tente apres qu'un nombre predetermine de de- 
mandes de verrouillage en provenance du 
noeud ont ete rejetees, et pour emmagasiner 
toutes les demandes de verrouillage subse- 15 
quentes en provenance de n'importe quel autre 
des noeuds en queue de la file d'attente suivant 
I'ordre dans lequel elles sont faites; et 
des moyens pour permettre de commander la 
file d'attente de facon a avancer les demandes 20 
de verrouillage emmagasinees depuis Pextre- 
mite queue de la file d'attente vers la tete de la 
file d'attente chaque fois que la demande de 
verrouillage se trouvant en tete de la file d'at- 
tente est prise en charge. 2s 

Circuit selon la revendication 5, comprenant un cir- 
cuit de commande couple a la file d'attente de ver- 
rouillage, dans lequel la file d'attente de verrouillage 
comprend une multiplicity de registres de file d'at- 30 
tente ayant chacun un dispositif de stockage, et 
dans lequel la multiplicity de registres de file d'at- 
tente fournissent soit un signal de refus de ver- 
rouillage, soit un signal de non correspondance de 
verrouillage en reponse a une demande de ver- 3$ 
rouillage; et 

le signal de non correspondance de ver- 
rouillage est achemine vers le circuit de commande 
pour activer le premier signal pour emmagasiner la 
demande de verrouillage. *o 

Circuit selon la revendication 5, dans lequel ladite 
file d'attente de verrouillage comprend une multipli- 
city de files d'attente de registres et comporte, en 
outre: *s 

une multiplicity de multiplexers, I'un des mul- 
tiplexers etant associe a chacun des registres de 
file d'attente, lesdits multiplexeurs recevant un se- 
cond signal pour commander la file d'attente de ver- 
rouillage. 50 

Circuit selon la revendication 6, dans lequel le si- 
gnal de refus de verrouillage »'Jtori*9 circuit de 
commande a generer un troisieme signal a destina- 
tion du compteur respectif associy au noeud gene- 55 
rant la demande de verrouillage. 



registre de file d'attente comprend: 

une zone Vindication de validity; et 

une zone d'identification de source de noeud. 

1 0. Circuit selon la revendication 9, dans lequel chaque 
dispositif de stockage comprend: 

une zone d'adresse: 

une zone d'identification de source de noeud; 
et 

un indicateur de validity. 



9. Circuit selon la revendication 6, dans lequel chaque 
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